KAN Society
from Diary 2024-07-11
KAN Society
ochyai When people say smooth society, I think differentiable society or something, but apparently not.
nishio "Smooth Society and Its Enemies" was published in 2013, the technology to combine differentiable components and optimize end-to- end optimization technology had not yet become practically feasible. Namely, the idea of "sigmoid instead of step function" will be the cornerstone of a differentiable society.
ochyai If you don't get caught up in the sigmoid, it's not a cyclic world but a KAN society.
nishio What is "KAN society?"
ochyai It's a gag that KAN: Kolmogorov-Arnold Networks society is called "sigmoid".
https://arxiv.org/abs/2404.19756
nishio Ah, I see. Well, since sigmoid is only mentioned as an example of a smooth function that is not a step function, I don't think it denies using other smooth functions like KAN. (serious pun intended).
---
This page is auto-translated from /nishio/KAN社会 using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.